Bailout Embeddings, Targeting of KAM Orbits, and the Control of Hamiltonian Chaos 
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We present a novel technique, which we term bailout embedding, that can be used to target orbits having par- 
ticular properties out of all orbits in a flow or map. We explicitly construct a bailout embedding for Hamiltonian 
systems so as to target KAM orbits. We show how the bailout dynamics is able to lock onto extremely small 
KAM islands in an ergodic sea. 
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Control of chaos in nonlinear dynamical systems has been 
achieved by applying small perturbations that effectively 
change the dynamics of the system around the region — typ- 
ically a periodic orbit — that one wishes to stabilize [[l|]. 
This method has been successful in dissipative systems, but 
its extensions to control and targeting in Hamiltonian sys- 
tems [§|3],§ilil|,ii|l0| have met various difficulties 
not present in the dissipative case: the absence of attracting 
sets, for instance, makes it hard to stabilize anything. In ad- 
dition, these methods require that one know in advance what 
one wants to do; in particular, the orbit to be stabilized may 
have to be known in advance to a fair accuracy. 

In this Letter we present a novel technique allowing us to 
control Hamiltonian chaos, in such a way as to keep the orig- 
inal dynamics intact, but which shifts the stability of differ- 
ent kinds of orbits in the dynamics. We do so by embedding 
our Hamiltonian system within a larger space, meaning we 
augment the number of degrees of freedom, keeping an in- 
tact copy of the original system on one privileged slice; all 
of the control is achieved through use of the perpendicular 
directions to this intact copy. We call this method a bailout 
embedding for reasons that will promptly become clear. We 
apply the technique to an extremely hard and hitherto close 
to intractable problem in chaos control of Hamiltonian sys- 
tems: selecting small KAM (Kolmogorov-Arnold-Moser) is- 
lands within chaotic seas in systems that are almost ergodic. 
We show below how our technique is able to find and render 
asymptotically stable minute islands of order within a map. 
While formerly this could be done by sophisticated algorithms 
on the basis of complex logic, our method distills the com- 
plexity of this calculation into a simple, forward-iterates dy- 
namical system. Thus our method allows us to stabilize KAM 
islands without knowing their location in advance. 

A striking application of Eq. is to a case rather close to 
the original setting of Eq. (|l]): an incompressible fluid flow 
u translates in dynamical-systems terms to a divergence-free 
flow, of which Hamiltonian systems are the most important 
class. A classical problem in Hamiltonian dynamics is locat- 
ing KAM tori. Hamiltonian systems live between two oppo- 
site extremes, of fully integrable systems and fully ergodic 
ones. Fully integrable systems are characterized by dynamics 
unfolding on invariant tori. The KAM theorem asserts that as 



a parameter taking the system away from integrability is in- 
creased, these tori break and give rise to chaotic regions in a 
precise sequence; for any particular value of this parameter 
in a neighborhood of the integrable case, there are surviving 
tori. The problem with finding them is that, the dynamics 
being volume-preserving, merely evolving trajectories either 
forwards or backwards does not give us convergence onto tori 
[[l3|], and since for large values of the nonlinearity, they cover 
a very small measure of the phase space, locating them be- 
comes an extremely difficult problem. Moreover, there is the 
further problem that even if we start on an island, we should 
be able to recognize it as such. In fact, several sophisticated 
analytical and semianalytical techniques had to be developed 
to assist in the search and characterization of KAM tori in 
highly nonlinear Hamiltonian systems (see for instance [[Tj]]). 
We shall now show that the bailout embedding solves these 
problems by transforming the KAM trajectories into global 
attractors of the embedded system; finding them is now inde- 
pendent of the choice of initial conditions. 

Our technique is based upon the dynamics of a small neu- 
trally buoyant sphere — a passive scalar — in an incompress- 
ible fluid flow u [|ri|. Under assumptions allowing us to retain 
only the Bernoulli, Stokes drag, and Taylor added mass con- 
tributions to the force exerted by the fluid on the sphere, the 
equation of motion for the sphere at the position x is 



dt 



(x — u{x)) — —(A + Vm) • {x -~ u{x)) 



(1) 



so that the difference between the particle velocity and the ve- 
locity of the surrounding fluid is exponentially damped with 
negative damping constant — (A + Vm). In the case in which 
the flow gradients reach the magnitude of the viscous drag co- 
efficient, there is the possibility that around hyperbolic stag- 
nation points the Jacobian matrix Vtt may acquire a positive 
eigenvalue in excess of the drag coefficient. In these instances, 
the trajectories of these passive scalars, instead of converging 
exponentially onto x — u, detach from such trajectories. The 
result is that the passive scalars explore practically all of the 
flow, but tend to stay away from regions of high shear. 

Equation |l] is but one instance of a more general structure. 
Let us consider a differential equation of the form x — f{x). 
If we take its time derivative, we obtain a different differential 
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FIG. 1 : We illustrate how the bailout embedding can target KAM orbits using the standard map at A: = 2. 100 random initial conditions were 
chosen, iterated for 10000 steps, then the next 1000 iterations are shown. The squares represent the unit torus, (a) Original map, (b) A = 1, (c) 
A = 0.6, (d) A = 0.5 



equation, x = f'{x)x. It is different because, being second 
order, it exists in a larger space and has many solutions that 
are not solutions of the smaller one. Still, the original equation 
is contained within the larger system, in the sense that every 
solution of i = f{x) is a solution of x — f'{x)x. We may 
say that x ~ f{x) is embedded within x — f'{x)x. There are 
infinitely many ways to embed; for example, x — f'{x)f{x) 
is also an embedding, but it is clearly inequivalent to the first. 

Of course, embedding a system changes notions of stabil- 
ity, because stability refers to perturbations, and in a larger 
system there are all of the old perturbations plus a batch of 
new ones. So, even though all of the solutions of the original 
system are preserved, by adding new directions away from the 
old solutions we may transform formerly stable solutions into 
unstable ones in the larger setting. See, for example, stud- 
ies of the manifold bubbling transition |12|. The trivial way 
to embed a system is through a cross product; for instance. 




iterations 



FIG. 2: As time passes, random initial conditions eventually col- 
lapse onto the original dynamics. Here we plot the fraction of initial 
conditions such that jsn+i — f{^n)\ > 10"^" as a function of the 
number of iterations elapsed, for 8000 random initial conditions, at 
k = 2. The three curves correspond to cases (bed) in Figure 1. 



X = f{x), a; G M is embedded within M 

i = f{x) +g{x,y), 
y = ay, 



(2) 



where g{x, y) is arbitrary except for requiring that g{x, 0) = 
0, which guarantees that for y = we have the original sys- 
tem. If a < then y always dies out, and so we always 
recover the original object; in this case, we can call the em- 
bedding itself stable, in the sense that any motion away from 
the embedded object takes us back. Both of the "derivative" 
embeddings in the previous paragraph were unstable; stable 
versions can be constructed rather simply, for instance 



dt 



{x- f{x))^-k{x- fix)), 



(3) 



of which the previous examples were the fc = limit. This 
embedding ensures that the distance between the actual trajec- 
tory and the embedding diminishes exponentially with time 
for any initial condition. Equation (^) begins to resemble 
Eq. ^. 

We define a bailout embedding as one of the form 



dt 



ix-f{x)) = -k{x) ix-f{x)), 



(4) 



where k{x) < on a set of orbits that are unwanted, and 
k{x) > otherwise. Thus the natural behavior of a bailout 
embedding is that the trajectories in the full system tend to de- 
tach or bail out from the embedded subsystem into the larger 
space, where they bounce around. If, after bouncing around 
for a while, these orbits reach a stable region of the embed- 
ding, k{x) > 0, they will once again collapse onto the original 
dynamical system. In this way we can create a larger version 
of the dynamics in which specific sets of orbits are removed 
from the asymptotic set, while preserving the dynamics of an- 
other set of orbits — the wanted or targeted one — as attrac- 
tors of the enlarged dynamical system. For the special choice 
of k{x) = — (A + V/), as in the fluid dynamics of a passive 
scalar described by Eq. dl]), these dynamics were shown in 
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FIG. 3: The bailout process can find small KAM islands. The standard map for k = 7 has a chaotic sea covering almost the entire torus, except 
for a tiny period 2 KAM island near position 0, 2/3. As in Figure 1, except: the squares here are a box —0.05 < a:: < 0.05, 0.61 < p < 0.71, 
1000 random initial conditions and 20000 stabilization iterations, (a) Original map, (b) A = 1.4, (c) A = 1.3, (d) A = 1.2. 



| [ri| ] to detach from saddle points and other unstable regions 
in conservative dynamics. 

It is not hard to extend flow bailout, Eq. (Q), to maps in 
the obvious fashion. Given a map Xn+i — T{xn) the bailout 
embedding is given by 

Xn+2 - T{Xn+l) K{Xn)iXn+l - T{x„)) (5) 

provided that |if > 1 over the unwanted set. (In the map 
system, almost any expression written for the ordinary differ- 
ential equation translates to something close to an exponen- 
tial; in particular, stability eigenvalues have to be negative in 
the ordinary differential equation case to represent stability, 
while they have to be smaller than 1 in absolute value in the 
map case). The particular choice of the gradient as the bailout 
function k{x) = — (A + V/) in a flow translates in the map 
setting to K{x) = e^^VT. A classical testbed of Hamil- 
tonian systems is the standard map, an area-preserving map 
introduced by Taylor and Chirikov. The standard map is given 
by 

k 

Xn+i = 2;„ + — sin(27ry„) 

Vn+l = yn+ Xn+1 (6) 

where k is the parameter controlling integrability. 

In order to embed the standard map, we only need to re- 
place T and K{x) in Eq. (pll with the appropriate expressions. 
T stems directly from Eq. (^ and, in accordance with the pre- 
vious definitions, K{x) becomes: 

K(x)^(^ fccos2^2/„ \ 

Notice that due to the area preserving property of the standard 
map, the two eigenvalues of the derivative matrix must mul- 
tiply to one. If they are complex, this means that both have 
an absolute value of one, while if they are real, generically 
one of them will be larger than one and the other smaller. We 
can then separate the phase space into elliptic and hyperbolic 
regions corresponding to each of these two cases. If a trajec- 
tory of the original map lies entirely on the elliptic regions. 



the overall factor exp(— A) will damp any small perturbation 
away from it in the embedded system. But for chaotic trajec- 
tories, which inevitably must visit some hyperbolic regions, 
there exists a value of A such that perturbations away from a 
standard map-trajectory are amplified instead of dying out in 
the embedding. As a consequence, trajectories are effectively 
expelled from the chaotic regions to finally settle in the safely 
elliptic KAM islands. This process can be observed clearly in 
Figure 1 . As the value of A is decreased, the number of tra- 
jectories starting from random initial conditions which even- 
tually settle into the KAM tori increases; see Figure 2. 

This process is sensitive enough to work even at hitherto 
intractably high nonlinearities. For k = 7, the standard map is 
almost ergodic: it covers almost the entire torus with a single 
chaotic orbit. Only a tiny island of irreductible order resists 
this invasion. It is located around (0, 0.6774) and covers an 
area approximately 2 x 10^^ of the torus. Thus, from random 
initial conditions one would expect to see this island only once 
every 50000 attempts. Figure 3 shows how easily our bailout 
method finds this island from simple forward iterates. 

A Hamiltonian system does not usually just satisfy volume 
conservation, but also will conserve the Hamiltonian itself. 
Given an ordinary differential equation x = f{x) with a con- 
served quantity E = Q, then / • WE = 0. However, building 
a bailout embedding by the procedure above does not lead to 
dynamics that satisfy E = 0, because the bailout embedding 
should be 2n — 2 dimensional. This is clearly undesirable in 
the case of Hamiltonian systems, so we show now how to de- 
rive a bailout embedding that will obey a conservation law. 
The bailout equation can be written 

i = (V/ - A) • (i - /) + V/ • i 

We need to correct this acceleration so that it stays on the sec- 
ond tangent space of the E = Q surface. Let us call the raw 
bailout acceleration u. The second derivative x has to satisfy 
X ■ VE + X ■ WE • i = 0, so we can modify u to 

u-WE VE 
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This equation, given that we start on x ■ VE = 0, will then 
preserve this property. 

We have presented a novel method in the control and target- 
ing of chaos in nonlinear dynamical systems, the bailout em- 
bedding. While potentially useful in any dynamical-system 
setting, this method is especially suited to Hamiltonian sys- 
tems. Unlike other chaos-control strategies, this method does 
not obliterate the original dynamics of the system, but rather 
preserves it in a privileged slice of phase space embedded in a 
higher-dimensional space, and merely shifts around the stabil- 
ity of its orbits. A suitable choice of a bailout function allows 
this strategy to target a complex set of orbits. We have shown, 
in particular, the targeting of KAM orbits, a case well-known 
from classical studies to be especially hard. 
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